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@ Multiple picture/sound signals decoding apparatus. 

(57) A multiple picture/sound signals decoding 
apparatus having a reduced-scale constitution 
and capable of reproducing multiple moving 
pictures simultaneously on a single display de- 
vice. For decoding input signals such as multi- 
ple moving picture signals and sound signals 
read out from a recording medium or those 
received via transmission lines, the apparatus 
comprises decoding means (104, 106, 108) for 
curtailing the input picture signals at a pre- 
determined interval to produce multiple picture 
signals reduced both horizontally and vertically, 
and decoding each of such multiple picture 
signals; frame memories (109, 110, 111) con- 
nected to the decoding means (104, 106, 108); 
means (115) for displaying the multiple pictures 
simultaneously on a single screen ; and means 
(112) for controlling the operations of the de- 
coding means (104, 106, 108) and the display 
means (115). In response to a mode selection 
signal, the control means (112) selects a multi- 
ple moving picture mode for displaying the 
reduced multiple moving pictures simul- 
taneously on a single screen of the display 
means (115), or a single moving picture mode 
for displaying merely one of the multiple mov- 
ing pictures on the screen of the display means 
(115). 
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BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an apparatus for 
decoding multiple moving picture signals and sound 
signals, and more particularly, to a decoding appara- 
tus based on the MPEG (Moving Picture Experts 
Group) system. 

Description of the Related Art 

Prior to giving a description with regard to the 
conventional multiple picture/sound signals decoding 
apparatus based on the MPEG system, a general en- 
coding method and apparatus will be explained. 

To begin with, an interframe motion predicting 
method in the MPEG system will be described below 
with reference to Fig. 15. In this diagram, first a pre- 
dictive-coded frame P0 is predicted from an intra-cod- 
ed frame 10. Subsequently a bidirectionally predictive- 
coded frame BO is predicted from the two frames 10 
and P0. And similarly another bidirectionally predic- 
tive-coded frames B1 is predicted from the intracoded 
frame 10 and the predictive-coded frame P0. For pre- 
diction of the bidirectionally predictive- coded frames 
BO and B1 1 there are known three modes such as for- 
ward prediction from the predictive-coded frame P0, 
backward prediction from the intra-coded frame 10, 
and interpolative prediction executed bidirectionally 
as mentioned above. And in practice, the most ade- 
quate one for data compression is selected out of 
such three modes. 

Hereinafter such intra-coded frame, forward pre- 
dictive-coded frame and bidirectionally predictive- 
coded frame will be referred to as I frame, P frame and 
B frame, respectively. Now a description will be given 
on an exemplary apparatus for compression coding 
and decoding signals of multiple moving pictures and 
sounds by the MPEG system. Fig. 16 is a block dia- 
gram of a multiple picture/sound signals encoding ap- 
paratus which is capable of multiplexing and encoding 
three moving pictures and three sounds. 

In Fig. 1 6, a digital moving picture signal V1 input- 
ted to a terminal Ta is supplied via a compression en- 
coder 1 and a buffer 2 to a multiplexer 13. Meanwhile, 
moving picture signals V2 and V3 inputted to termi- 
nals Tb and Tc respectively are supplied via compres- 
sion encoders 3. 5 and buffers 4, 6 to the multiplexer 
13. A sound signal A1 of the moving picture signal V1 
is inputted to a terminal Td and then is supplied via a 
compression encoder 7 and a buffer 8 to the multi- 
plexer 13. Similarly, sound signals A2 and A3 are sup- 
plied via compression encoders 9, 11 and buffers 10, 
12 to the multiplexer 13. 

Subsequently such signals are multiplexed by the 
multiplexer 13, whose output is then delivered via a 
buffer 14 to a terminal Tg and is further supplied to a 



storage medium or a transmission line. Fig. 17 shows 
an exemplary data arrangement of the output signal 
obtained from the terminal Tg. The three moving pic- 
ture signals and the three sound signals thus com- 

5 pression-coded are multiplexed in the direction of the 
time base, as shown in Fig. 17. Fig. 18 is a block di- 
agram of the moving picture compression encoder 
shown in Fig. 16. This encoder is of a general type 
equipped with a combination of a DCT (discrete co- 

10 sine transformer) and an interframe predictor. In Fig. 
18, a moving picture signal a fed to a video input ter- 
minal T1 is stored in a frame memory 21 and then is 
supplied to a subtracter 22 in the next stage. The out- 
put of the subtracter 22 is an interframe predictive dif- 

15 fere nee signal which represents the difference be- 
tween the input picture signal supplied to the positive 
terminal of the subtracter 22 and the predictive pic- 
ture signal supplied to the negative terminal thereof. 
The interframe predictive difference signal is 

20 supplied via a DCT 23 and a quantizer 24 to two trans- 
mission lines. 

The signal from one transmission line is inputted 
to a variable length encoder 25 and then is multi- 
plexed with motion vector data d and so forth in amul- 

25 tiplexer 26, and the multiplexed signal is delivered as 
an encoder output e from an output terminal T2 via a 
buffer 27. Meanwhile the signal from the other trans- 
mission line is processed in an inverse quantizer 28, 
an inverse DCT 29 and an adder 30, and then is out- 

30 putted as a decoded picture signal b. Subsequently 
the picture signal b is inputted via a frame memory se- 
lector switch SW1 to frame memories 31 and 32. 

Amotion vector calculator 33 generates a motion 
vector d on the basts of the input data obtained from 

35 the frame memories 21, 31 and 32. 

A predictive picture generator 34 generates a pre- 
dictive picture signal c on the basis of both the motion 
vector data d obtained from the motion vector calcu- 
lator 33 and the picture signal stored in the frame 

40 memories 31 and 32. 

The predictive picture signal c is supplied to the 
negative terminal of the subtracter 22 via a switch 
SW2 while being supplied also to the adder 30 via a 
switch SW3. When the decoded picture signal b rel- 

45 ative to the I and P frames, the switch SW1 is 
changed alternately so that local decoded picture sig- 
nals of the I and P frames are supplied to the frame 
memories 31 and 32. 

The switches SW2 and SW3 are closed in the P 

so and B frames where the motion is predicted, and a 
subtraction and an addition for prediction of the pic- 
ture are executed in the subtracter 22 and the adder 
30, respectively. The switches SW2 and SW3 are 
open in the I frame where the motion is not predicted, 

55 so that none of a subtraction and an addition for pre- 
diction of the picture is executed in the subtracter 22 
and the adder 30. Fig. 19 shows a conventional mul- 
tiple picture/sound signals decoding apparatus which 
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is complementary to the multiple picture/sound sig- 
nals encoding apparatus of Fig. 16. 

In Fig. 19, a multiplexed code obtained from a ter- 
minal Tg' is supplied via a buffer 35 to an inverse mul- 
tiplexer 36, where the multiplexed code is separated 
into three moving picture signals V1 , V2, V3 and three 
sound signals A1, A2, A3. And such signals are sup- 
plied to respective decoders. The moving picture sig- 
nal V1 is supplied via a buffer 37 to a decoder 38, and 
the decoded signal therefrom is supplied to a D-A 
converter 39 where digital-to-analog conversion is 
executed. And the analog signal thus obtained is sup- 
plied to a display device 40. Similarly the moving pic- 
ture signals V2 and V3 are supplied via buffers 41 , 45 
respectively to decoders 42, 46 so as to be decoded. 

The sound signal A1 is supplied via a buffer 49 to 
a decoder 50, and the decoded signal therefrom is 
further supplied via a D-A converter 51 to a reproduc- 
er 52. Similarly the sound signals A2 and A3 are proc- 
essed in the same manner. Fig. 20 is a block diagram 
of the decoder 38 (42, 46) shown in Fig. 19. A signal 
e fed to an input terminal T3 is supplied via a buffer 
61 to an inverse multiplexer 62, where the signal e is 
separated into the quantized moving picture signal 
and the motion vector data d. The compression-cod- 
ed moving picture signal is decoded to an interframe 
predictive difference signal by a variable length de- 
coder 63, an inverse quantizer 64 and an inverse DCT 
65, and then is supplied to an adder 66. The adder 66 
receives, besides such difference signal, a predictive 
picture signal inputted thereto via a switch SW5 from 
a predictive picture generator 69 on the basis of the 
data obtained from the frame memories 67 and 68, so 
that the two signals are added to each other to pro- 
duce a decoded picture signal. 

The decoded picture signal thus obtained is stor- 
ed in the frame memory 67 or 68 to become the data 
for producing a predictive picture signal while being 
inputted to a frame selection switch 70. The switch 
SW4 is changed every time the I and P frames are de- 
coded, and the switch SW5 is closed in the P and B 
frames where the motion is predicted. The switch 
SW5 is open in the I frame, so that the output of the 
predictive picture generator 69 is not added by the ad- 
der 66. 

In the frame selection switch 70, the decoded pic- 
tures are arranged in the display sequence and then 
are outputted to a terminal T4. 

In decoding and reproducing the compression- 
coded signals of multiple moving pictures and sounds 
mentioned above, it is necessary to prepare multiple 
decoders, D-A converters, display devices and repro- 
ducers equal in number to the moving pictures and 
the sounds, as shown in Fig. 19. Therefore, the ap- 
paratus is rendered great in both structure and scale 
to be consequently inadequate for general use in par- 
ticular. 



SUMMARY OF THE INVENTION 

It is an object of the present invention to provide 
5 an improved multiple picture/sound signals decoding 
apparatus which is capable of simultaneously repro- 
ducing multiple moving pictures by a single display 
device and further reducing the scale of the appara- 
tus constitution. 
10 According to one aspect of the present invention, 

there is provided an improvement in an apparatus for 
decoding input signals inclusive of multiple compres- 
sion-coded moving picture signals and sound signals 
read out from a recording medium and also signals re- 
ts ceived via transmission lines. Such improved appara- 
tus comprises a decoding means for curtailing the in- 
put picture signals at a predetermined interval to pro- 
duce multiple picture signals reduced both horizontal- 
ly and vertically, and decoding each of such multiple 
20 picture signals; frame memories connected to the de- 
coding means; a means for displaying the multiple 
pictures on a single screen; and a means for control- 
ling the operations of the decoding means and the 
display means. 
25 In this decoding apparatus, the decoding means 

comprises a means for separating motion vectors 
from the input signals; a means for generating the re- 
duced multiple picture signals; a means for reducing 
the motion vectors in conformity with the reduction 
30 rate of the picture signals; and a means for generating 
a predictive picture on the basis of the reduced pic- 
ture signals and the reduced motion vectors. 

Further in the decoding apparatus, the control 
means is capable of selecting, in response to a mode 
35 selection signal, a multiple moving picture mode for 
displaying the reduced multiple moving pictures on a 
single screen of the display means, or a single moving 
picture mode for displaying merely one of the multiple 
moving pictures on the single display means. 
40 When the multiple moving picture mode is select- 

ed in such decoding apparatus of the present inven- 
tion, the output of an inverse DCT is first reduced by 
means of a reducer both horizontally and vertically, 
and then is supplied to an adder. The number of frame 
45 memories required for decoding P and B frames need 
not be equal to the number of the moving pictures, 
and one frame memory is divided into a plurality of 
memories which are used independently of one an- 
other. The decoded moving pictures are supplied via 
50 display control means to a single display means 
where the moving pictures are displayed simultane- 
ously. Meanwhile in the single moving picture mode, 
reduction of the multiple moving pictures is not exe- 
cuted, and one of such multiple moving pictures is de- 
55 coded by the conventional known method and then is 
displayed on the display means. 

The sound signals are switched in conformity 
with the selected mode. 

The above and other features and advantages of 
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the present invention will become apparent from the 
following description which will be given with refer- 
ence to the illustrative accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a first embodiment 
representing the multiple picture/sound signals 
decoding apparatus of the present invention; 
Fig. 2 is a block diagram showing the details of a 
decoder employed in the apparatus of Fig. 1; 
Fig. 3 illustrates an exemplary display state on a 
display screen in a multiple moving picture mode 
in the apparatus of Fig. 1; 
Fig. 4 shows how the storage space in a frame 
memory is divided for use in the apparatus of Fig. 
1; 

Fig. 5 illustrates an exemplary display state on a 
display screen in a single moving picture mode in 
the apparatus of Fig. 1; 

Fig. 6 is a block diagram showing the details of a 
multiple sound signals decoder employed in the 
apparatus of Fig. 1; 

Fig. 7 is a block diagram of a second embodiment 
representing the multiple picture/sound signals 
decoding apparatus of the present invention; 
Fig. 8 is a connection diagram showing the de- 
tails of a selector employed in the apparatus of 
Fig. 7; 

Fig. 9 illustrates another exemplary display state 
on a display screen in a multiple moving picture 
mode in the apparatus of Fig. 1; 
Fig. 10 is an explanatory diagram of an inter- 
frame motion predicting method based on the 
MPEG system; 

Fig. 11 shows the kinds and the sequence of 
frames of moving pictures encoded in an appara- 
tus of Fig. 16; 

Fig. 12 is an explanatory diagram showing the 
sequence of frames decoded in the apparatus of 
Fig. 1 and also the sequence of frames stored in 
the frame memory; 

Fig. 13 is another explanatory diagram showing 
the sequence of the frames decoded in the appa- 
ratus of Fig. 1 and also the sequence of frames 
stored in the frame memory; 
Fig. 14 is a further explanatory diagram showing 
the sequence of the frames decoded in the appa- 
ratus of Fig. 1 and also the sequence of frames 
stored in the frame memory; 
Fig. 15 shows the sequence of frames stored in 
the frame memory; 

Fig. 16 is a block diagram of a general multiple 
picture/sound signals encoding apparatus; 
Fig. 1 7 shows an exemplary arrangement of cod- 
ed data outputted from the multiple picture/sound 
signals encoding apparatus of Figs. 16 and 18; 
Fig. 18 is a block diagram showing the details of 



a compression encoder employed in the appara- 
tus of Fig. 16; 

Fig. 19 is a block diagram of a conventional mul- 
5 tiple picture/sound signals decoding apparatus; 

Fig. 20 is a block diagram showing the details of 
a decoder employed in the apparatus of Fig. 19; 
Fig. 21 illustrates how a picture signal is reduced 
to 1/2 both horizontally and vertically; and 
10 Fig. 22 schematically shows pixels in one frame. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

15 Hereinafter exemplary embodiments represent- 

ing the multiple picture/sound signals decoding appa- 
ratus of the present invention will be described in de- 
tail with reference to the accompanying drawings. 
In the embodiments, the process of decoding 

20 multiple moving picture signals signifies an operation 
of reading out multiple kinds of moving pictures from 
a recording medium (such as optical disk, magneto- 
optical disk, magnetic disk or any other storage me- 
dium) or from a transmission line and decoding the 

25 read signals, and further includes an operation of div- 
iding one kind of successive moving pictures into mul- 
tiple signals and decoding such divided picture sig- 
nals. 

Fig. 1 is a block diagram of a first embodiment 

30 representing the multiple picture/sound signals de- 
coding apparatus of the present invention. This appa- 
ratus is capable of decoding three independent mov- 
ing picture signals V1, V2, V3 and three independent 
sound signals A1 , A2, A3, and has two display modes, 

35 i.e., a multiple moving picture mode and a single mov- 
ing picture mode. (For the purpose of averting com- 
plication of the diagram, the sound signal decoding 
circuit is shown separately in Fig. 6.) 

In the multiple moving picture mode, the moving 

40 picture signals V1 , V2 t V3 are so processed that each 
picture is reduced to 1/2 both horizontally and verti- 
cally and is displayed in 1/4 divided area of one whole 
screen as illustrated in Fig. 3. In this diagram, the low- 
er right area is blank. 

45 First a description will be given on the operation 

performed in the multiple moving picture mode. 

The multiplexed picture/sound code inputted via 
a terminal T5 to a buffer 101 is supplied to an inverse 
multiplexer 102, where the input code is separated 

so into moving picture signals and sound signals. (As 
mentioned, the sound processing circuit is shown in 
Fig. 6 so as to avert complication of the diagram.) The 
moving picture signals V1 , V2, V3 thus separated are 
supplied to decoders 104, 106, 108 respectively. 

55 Fig. 2 shows the details of the decoder 104 (106, 

108). The input signal e received at a terminal T6 is 
supplied via a buffer 301 to an inverse multiplexer 
302 t where the motion vector data d is separated. 
Subsequent processes executed sequentially in a va- 
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liable length decoder 303, an inverse quantizer 304 
and an inverse DCT 305 are exactly the same as 
those executed in the aforementioned decoder 
shown in Fig. 20. The output of the inverse DCT 305 
is branched into two, and one is supplied to a switch 
SW301 while the other to a reducer 306. 

In the reducer 306, the pixels are curtailed alter- 
nately in the horizontal and vertical directions so that 
the picture signal is reduced to 1/2 both horizontally 
and vertically. 

This process is illustrated in Fig. 21 where each 
circle denotes an individual pixel. The picture is re- 
duced to 1/2 both horizontally and vertically by col- 
lecting the alternate pixels (denoted by hatched cir- 
cles). 

The switch SW301 is controlled by a signal CNT1 
(n=1 in the decoder 104) obtained from the controller 
112 shown in Fig. 1. In the multiple moving picture 
mode, the switch SW301 is connected to (m) so that 
the output of the reducer 306 is supplied to an adder 
308. 

Meanwhile the motion vector data d separated in 
the inverse multiplexer 302 is branched and supplied 
to a divider 309. In accordance with reduction of the 
picture signal to 1/2 in the horizontal and vertical di- 
rections, the motion vector data d is also reduced to 
a 1/2 value in the divider 309. On the basis of the mo- 
tion vector (X, Y) (where X stands for the horizontal 
component of the motion vector and Y for the vertical 
component thereof), there is obtained a vector (X/2, 
Y/2) from the divider 309. Namely, the motion vector 
data is reduced in conformity with the reduction rate 
of the picture signal. 

A switch SW304 is controlled also by the signal 
CNT1 similarly to the aforementioned switch SW301 
and is connected to (m) in the multiple moving picture 
mode, whereby the output of the divider 309 is sup- 
plied to a predictive picture generator 307. A switch 
SW302 is closed in the P and B frames, so that a pre- 
dictive picture outputted from the predictive picture 
generator 307 is added by an adder 308 to the output 
of the switch SW301. However, nothing is added to 
the I frame. 

The output of the adder 308 is supplied to a 
switch SW303. The connection of the switch SW303 
is alternately changed to terminals XnW and YnW ev- 
ery time the I and P frames are decoded, and it is con- 
nected to a terminal ZnW at the time of the B frame. 
The terminals XnW, YnW, ZnW are connected re- 
spectively to the frame memories 109, 110, 111 
shown in Fig. 1, and the individual data of the three 
frames are stored in such memories respectively. (In 
Fig. 1, XnR and XnW are denoted by a single line Xn 
(R, W) for averting complication of the diagram.) Each 
of the frame memories 109, 110, 111 is divided into 
four similarly to the display screen, and the data are 
written in or read out from the divided storage spaces 
independently of one another. 



Figs. 4(a) to 4(c) show the storage spaces of the 
frame memories 109, 110, 111 in a manner that the 
pixel data stored in the memories coincide with the 
5 positions on the display screen. Figs. 4(a), 4(b) and 
4(c) represent the contents of the X frame memory 
1109, the Y frame memory 1110 and the Z frame 
memory 1111, respectively. 

If one frame is composed of horizontal m pixels by 
10 vertical n pixels as shown in Fig. 22, each pixel can 
be expressed as 

Fm [i, j] where 0==i<m, 0==j<n 
In Fig. 4(a) for example, three kinds of pictures re- 
duced to 1/2 both horizontally and vertically are star- 
ts ed in the areas XV1, XV2, XV3. The pixels in the in- 
dividual pictures are expressed as 

XV 1 [M, j1] where 0 ^ 11 < m/2, 0 ^ j1 < n/2 
XV2 [i2, j2] where 0 ^ i2 < m/2, 0 =i ]2 < n/2 
XV3 [i3, j3] where 0 =sj3 < m/2, 0 ^ j3 < n/2 
20 The following equations represent the positions 

in the frame memories where t he pixels of the individ- 
ual pictures are practically written. 

Fm[i1,j1] = XV1 [M, j1] 
Fm [i2 + m/2, ]2] = XV2 p2, J2] 
25 Fm [i3 + m/2, j3 + m/2] = XV3 [i3, j3] 

In the divided areas XV1, XV2 and XV3, the pic- 
ture data are written and read independently of one 
another in the same manner as in the individual dif- 
ferent memories. The same operation is performed in 
30 the other memory areas YV and ZV as well. As obvi- 
ous from Figs. 1, 2 and 4, the data inputted from the 
terminal X1 W is written in the memory space XV1 and 
is read out therefrom to the terminal X1R. The oper- 
ation is the same with respect to X2, X3, Y and Z as 
35 well. In accordance with the method for prediction of 
the P and B frames, the decoded picture data ob- 
tained from the memories 109 and 110 are supplied 
via the terminals X1R, Y1R to the predictive picture 
generator 307, where a predictive picture is generat- 
40 ed on the basis of the motion vector d and then is out- 
putted to the switch SW302. (As mentioned, XnR and 
XnW are denoted by a single line Xn (R, W) in Fig. 1 
for averting complication of the diagram.) Similarly to 
the above example described with regard to the mov- 
45 ing picture signal V1, it is to be understood that the 
same process is executed relative to the moving pic- 
ture signals V2 and V3 independently of each other. 
With the exception that the picture signal is reduced 
to 1/2, the decoding process described above is the 
so same as that executed in the decoder of Fig. 20. The 
decoded picture of the B frame obtained from the de- 
coder 104 (106, 108) is written in the frame memory 
111. Meanwhile the decoded pictures of the I and P 
frames to be displayed simultaneously with the B 
55 frame are read outfrom the frame memories 109, 110 
and then are written in the frame memory 111. 

Now the timing of inputting the picture signals 
into the frame memory 111 will be described below. 
Fig. 10 shows the sequence of allocation of the I, P 
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and B frames relative to the input moving picture sig- 
nals V1, V2, V3 in the encoding apparatus of Fig. 16. 
Since the moving picture signals V1, V2, V3 are mu- 
tually independent, the sequence of the I, P t B frames 
is not exactly coincident therewith. However, a coin- 
cidence in the sequence of the frames is preferable 
for the reason that the algorithm required for gener- 
ating a predictive picture by dividing each frame mem- 
ory can further be simplified. 

Figs. 11 to 13 show the decoding sequence and 
the storage sequence of the picture data in the frame 
memories 109 and 110. The V1 decoding of Fig. 11 
represents the sequence of decoding the I, P, B 
frames in the output signal of the adder 308 in Fig. 2. 
In Fig. 11 f XV1 and YV1 signify the sequence of stor- 
ing the data of the I and P frames in XV 1 of the frame 
memory 109 and YV1 of the frame memory 110, re- 
spectively. In Figs. 12 and 13, V2 and V3 represent 
the same decoding sequence. 

ZV1, ZV2, ZV3 in Fig. 14 signify the sequence of 
storing the data in ZV1 , ZV2, ZV3 of the frame mem- 
ory 111 respectively. 

In an exemplary case of inputting the frame No. 
4, P4 is read out from XV1 and is written in ZV1, and 
also 14 is read out from XV3 and is written in ZV3. 
Meanwhile B4 obtained from the decoder 106 of Fig. 
1 is loaded directly in ZV2 via the signal line Z2. 

As the frames of the same number are thus input- 
ted into the frame memory 111, the frames are rear- 
ranged to resume the sequence shown in Fig. 10, i.e., 
the frame sequence of the original pictures prior to 
the encoding, and the rearranged data is outputted to 
an LPF 113 and a switch SW101 shown in Fig. 1. 

The above operation is controlled by control sig- 
nals CNT (1, 2, 3) and CNT (X, Y, Z) outputted from 
the controller 112. 

The LPF 1 1 3 is a low pass filter for eliminating the 
noise caused by the curtailment executed in the re- 
ducer 306 shown in Fig. 2, and its operation is per- 
formed in both horizontal and vertical directions of 
the screen. The switch SW1 01 is connected to (m) in 
the multiple moving picture mode, and the output sig- 
nal of the LPF 113 is supplied to a D-A converter 114 
where digital-to-analog conversion is executed. The 
analog signal thus obtained is then supplied to a dis- 
play device 115, where three reduced pictures are 
displayed as illustrated in Fig. 3. (Denoted by 1115 in 
Fig. 3 is a screen of the display device 115.) 

Hereinafter the operation in the single moving 
picture mode will be described. 

Suppose now that the picture signal V1 is select- 
ed in the single moving picture mode. Then the switch 
SW301 incorporated in the decoder 104 is connected 
to (s) so that a nonreduced normal picture signal is 
decoded. Similarly the switch SW304 is connected 
also to (s), so that a nondivided former motion vector 
data d is inputted to the predictive picture generator 
307. 



The frame memories 109 and 110 are not divided 
differently from Fig. 4, and each serves as a single 
whole frame memory. Therefore, each frame memory 

5 functions in the same manner as in the decoder 
shown in Fig. 20. Namely, the frame memory 109 
functions like the frame memory 67 in Fig. 20, and the 
frame memory 1 1 0 like the frame memory 68, respec- 
tively. Meanwhile the frame memory 111 isfunction- 

10 ally the same as the frame selection switch 70 in Fig. 
20. The switch SW101 is connected to (s), and the 
output signal from the frame memory 111 is supplied 
via the D-A converter 114 to the display device 115 
without being passed through the LPF 113. 

15 On the screen of the display device 115, the pic- 

ture of the signal V1 is displayed in a normal size as 
illustrated in Fig. 5. 

The actions of the switches and so forth execut- 
ed in accordance with selective switchover of the op- 

20 eration modes is performed by the controller 112. The 
control signal (mode selection signal) used for con- 
trolling the switches and so forth may be selectively 
generated with depression of an external switching 
button or the like by a user to select a desired mode. 

25 It is also possible to preset the switching condition by 
the user in a manner to switch the operation mode at 
a predetermined time interval of, e.g., 10 minutes or 
so. 

Fig. 6 shows an exemplary sound decoding ap- 

30 paratus. The sound signal A1 separated in an inverse 
multiplexer 1 02 is inputted via a buffer 203 to a decod- 
er 204 and then is supplied to a selector 209. The 
other sound signals A2 and A3 are also processed in 
the same manner. In the multiple moving picture 

35 mode, the selector 209 selects desired ones of the 
sound signals A1 , A2, A3 in response to a control sig- 
nal (mode selection signal) obtained from a controller 
112. Meanwhile in the single moving picture mode, 
the selector 209 selects the sound signal of the se- 

40 lected moving picture. The selected sound signal is 
supplied to a D-A converter 210 and then is repro- 
duced by a reproducer which consists of an amplifier 
211 and a speaker 212. 

Hereinafter a second embodiment of the present 

45 invention will be described. When the signal decoding 
speed of the decoders 104, 106, 108 in Fig. 1 is suf- 
ficiently high, it is not necessary to provide a decoder 
for each channel, and multiple moving pictures can be 
decoded by means of a single decoder through a time 

so division process. The detail of such second embodi- 
ment is shown in Fig. 7 (where X1W and X1R are de- 
noted simply by X1 for averting complication of the di- 
agram). 

As in the decoding apparatus of Fig. 1, the input 
55 signal from a terminal T7 is supplied via a buffer 401 , 
an inverse multiplexer 402 and a buffer 403 to a de- 
coder 404. This decoder 404 is the same in constitu- 
tion as the aforementioned decoder shown in Fig. 2. 
Picture signals V1, V2, V3 decoded by the decoder 
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404 are time-divided and outputted sequentially from 
terminals X, Y, Z thereof. The output signals thus ob- 
tained are then delivered to a selector 405. The selec- 
tor 405 is so constituted as shown in Fig. 8, where the 
connection to frame memories 406, 407, 408 is selec- 
tively changed in accordance with the decoded mov- 
ing picture signals V1 , V2, V3 by a control signal s ob- 
tained from the decoder 404. For example, when the 
data is the moving picture signal V1 , XW is connected 
to X1W, XR to X1R, YW to Y1W, YR to Y1 R, and ZW 
to Z1 W, respectively. 

The subsequent processes are exactly the same 
as those described with regard to the decoding appa- 
ratus of Fig. 1 . In case the processing speed of the de- 
coder is sufficiently high, the constitution of Fig. 7 is 
also capable of achieving the same function as that 
of Fig. 1. 

The description given hereinabove is concerned 
with an exemplary case of moving pictures of three 
channels. However, it is to be understood that the ap- 
paratus mentioned is capable of complying with mov- 
ing pictures of any number of channels merely by 
changing the division of the frame memories and the 
reduction rate of the decoded pictures. 

For example, pictures reduced to 1/3 in the hori- 
zontal and vertical directions can be obtained by cur- 
tailing every third pixel in Fig. 21 instead of alternate 
pixels. And if the frame memory is equally divided into 
three both horizontally and vertically, a maximum of 
9-channel pictures can be simultaneously decoded 
and displayed. 

Although the above description has been given 
with regard to an example of the MPEG system, the 
present invention is applicable also to any other pic- 
ture compression system which performs motion pre- 
diction. 

In the multiple moving picture display mode, it is 
not exactly necessary to display the entire input mov- 
ing pictures on the screen, and the user may select 
merely desired ones for display. 

In addition to the above example relative to the 
method of displaying multiple moving pictures simul- 
taneously by dividing the screen into multiple areas 
as illustrated in Fig. 3, there may be adopted another 
method that uses multiple windows for displaying the 
pictures. According to such method, the individual 
pictures are displayed in respective windows, and any 
desired picture can be selected by employing func- 
tions of opening, closing, displacing, enlarging and re- 
ducing the windows. Fig. 9 shows a method of dis- 
playing multiple moving pictures with such windows. 

As mentioned hereinabove, when multiple mov- 
ing pictures are simultaneously reproduced in the 
multiple picture/sound signals decoding apparatus of 
the present invention, the moving picture signals are 
decoded with horizontal and vertical reduction, so 
that the required frame memories need not be equal 
in number to the moving pictures, and merely one set 



of frame memories are sufficient for decoding the sig- 
nals. Since the display screen is divided for displaying 
multiple moving pictures, the provision of a single dis- 

5 play means meets the requirement. Thus, it becomes 
possible to minimize the number of the frame mem- 
ories and the display means to consequently diminish 
the constitution scale of the multiple picture/sound 
signals decoding apparatus. 

w Furthermore, either multiple moving pictures or a 

single one thereof can be selectively displayed due to 
switchover of the picture display modes. 



15 Claims 

1 . An apparatus for decoding input signals such as 
multiple moving picture signals and sound signals 
read out from a recording medium or those re- 

20 ceived via transmission lines, said apparatus 

comprising: 

decoding means (104, 106, 108; 404) for 
curtailing the input picture signals at a predeter- 
mined interval to produce multiple picture signals 

25 reduced both horizontally and vertically, and de- 

coding each of such multiple picture signals; 

frame memories (109, 110, 111, 406, 407, 
408) connected to said decoding means (104, 
106, 108; 404); 

30 means (115; 412) for displaying the multi- 

ple pictures simultaneously on a single screen; 
and 

means (112; 409) for controlling the oper- 
ations of said decoding means (104, 106, 108; 
35 404) and said display means (115; 412). 

2. The apparatus according to claim 1 , wherein said 
decoding means (104, 106, 108; 404) comprises 
means (302) for separating motion vectors from 

40 the input signals; means (306) for generating the 

reduced multiple picture signals; means (309) for 
reducing the motion vectors in conformity with 
the reduction rate of the picture signals; and 
means (307) for generating a predictive picture 

45 on the basis of the reduced picture signals and 

the reduced motion vectors. 

3. The apparatus according to claim 2, wherein said 
control means (112; 409) is capable of selecting, 

so in response to a mode selection signal, a multiple 

moving picture mode for displaying the reduced 
multiple moving pictures simultaneously on a sin- 
gle screen of said display means, or a single mov- 
ing picture mode for displaying merely one of the 

55 multiple moving pictures on the screen of said 

display means (115; 412). 

4. The apparatus according to claim 3, wherein, 
when the selected display mode is a multiple 
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moving picture mode, said control means (112; 
409) divides said frame memories into multiple 
storage spaces and using such spaces indepen- 
dently of one another for generation of predictive 5 
pictures. 

5. The apparatus according to claim 3 or 4, wherein 
said mode selection signal is generated in re- 
sponse to a manipulation of an external means 10 
performed by a user for selecting a desired 
mode. 

6. The apparatus according to claim 3 or 4, wherein 
said mode selection signal is generated in con- 15 
formity with the mode switching condition preset 

in advance. 

7. The apparatus according to claim 1 , wherein said 
display means (115; 412) displays the multiple 20 
moving pictures in multiple windows. 
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(g) Multiple picture/sound signals decoding apparatus. 

(g?) A multiple picture/sound signals decoding 
W apparatus capable of reproducing multiple 
moving pictures simultaneously on a single dis- 
play device. For decoding input signals such as 
multiple moving picture signals and sound sig- 
nals read out from a recording medium or those 
received via transmission lines, the apparatus 
comprises decoding means (104,106,108) for 
curtailing the input picture signals at a pre- 
determined interval to produce multiple picture 
signals reduced both horizontally and vertically, 
and decoding each of such multiple picture 
signals ; frame memories (109.110.111) connec- 
ted to the decoding means (104,106,108), 
means (115) for displaying the multiple pictures 
simultaneously on a single screen ; and means 
(112) for controlling the operations of the de- 
coding means (104,106,108) and the display 
means (115). In response to a mode selection 
signal, the control means (112) selects a multi- 
ple moving picture mode for displaying the 
reduced multiple moving pictures simul- 
taneously on a single screen of the display 
means (115), or a single moving picture mode 
for displaying merely one of the multiple mov- 
ing pictures on the screen of the display means 

(115). . . 

In the multiple moving picture mode, the 
images can be displayed in adjustable windows. 

Furthermore, a fast decoder can be used in 
multiplex to decode the multiple picture sig- 
nals. 
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